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ABSTRACT 


Ihe objective of this study is to develop and test two 
new approximate solution techniques for a moving target 
problem in discrete time and space where both the searcher 
and the target nave constraints on their paths. The first 
technique is an application of the Local Search Method and 
the seccnd technique is an application of the Franx-Wolfe 
Method. The motivation for looking at approximate methods 
is that the problem is NP-conplete and optimal solution 
techniques become impractical tor large size problems. 
Experiments showed that the Local Search Method approach is 
an efficient tecanigue for obtaining approximate solutions. 
However, the Frank-Wolfe Method approach does not perform 
well for the problem. 
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I. INTRODUCTION 


A. THE PROBLEH 


The problem considered here is the search for а moving 
target in discrete time and space, where there are 
constraints on the  searcher's movement. The target 15 


assumed to move among a finite set of cells С=(1,...,1) 


according to a specified Markov transition matrix 
22 (2 (1, 3) ]- The target's motion is independent of the 
searcher's actions. The transition matrix is known to the 


searcher as well as the initial distribution of the target 
over the search cells. In each time period one cell is 
searched. The searcher is able to move from his current 
cell, say i, to a cell which must be selected frcm a given 
subset C(1) of the set C. Thus, the search cell in a given 
time period must be within some specified neighborhood of 
the search cell in the previous time period. If Ene 
Searcher and the target are in the same cell і, the target 
will ke detected with probability 4(1). If the target is 
not in the cell which iS searched, it cannot be detected 
during the time period. The objective of tae search is to 
find a T-time period search path which minimizes the prob- 
ability of non-detection (PND). 


B. BACKGROUND 


The problem of searching fcr a moving target in discrete 
time and space has received considerable attention. Ihe 
problem is úifficult because of its complexitjy. rurazel aad 
Weisinger [Ref. 1] proved that optimal constrained path 
search problem for a stationary target in discrete time and 


space where the time horizon is finite and the measure of 


effectiveness is PND, is NP-Conplete. Since the stationary 
target probiem is NP-Complete, tne moving target problem is 
also NP-Conplete. For more information on NP-complete ргор- 
lens, see (Ref. 2]. The optimal solution techniques which 
have been used to solve the constrained pata moving target 


problem are: 
1. Total enumeration 
2. The dynamic programming technique of Eagle [Ref. 3]. 


The total enumeration method is complete enumeration of 
all pcssible search paths. The disadvantage of this method 
is the exponential increase in computer time as the problea 
size increases. However, it has the advantage of requiring 
very little computer storage. Eagle formulates the problen 
as a Partially Observable Markov Decision Process (РОМОР), 
and the method requires extensive computer storage, but 
finds solutions more quickly than the total enumeration 
met hcd. 


Since the ргоһіеш 15 NP-Coaflete, ПЕЕ ۴ ۲ to 
solve large problens. For large problens, heuristic or 
approximate solution techniques have been proposed. Such 


methods were developed by Stewart [Ref. 4] and Eagle 
[Ref. 5]. 

Stewart developed а hranch-and-bound algoritam tor the 
solution of the problem. However, optıaality cannot ре 
quaranteed because exact bcunds cannot ге obtained. 
Nevertniess, Stewart used one-dimensional a random walk as a 
test problem апа demonstrated that the algorithm performs 
efficiently. 

Eagle's approximate procedure is аз simpler version of 
his optimal dynamic programming method. Eaqle used moving 
horizcn policies and also looked for a lower bound for the 


minimal PND. Eagle's computational experience with 


two-dimensional search problems showed the m-time period 
moving horizon policies (m-TPMH) do not necessarily perform 
better as m increases. Nonetheless, the method does show 
some promise. Тһе m-TPMH policy selects as the next search 
that cell which would be optimal if m-time periods remained 
in the problen. 

Recently Eagle and Yee developed a new approximate solu- 
tion method by using the convex simplex method [Bef. 6]. 
Two-dimensional computational experiments showed that the 
methcd performs well. 

In this thesis two new approximate solution techniyues 
will te studied and tested. The first method is a heuristic 
approach which is an application of the Local (Neighborhood) 
Search. The second technique iS an application of the 


Frank-Wcife metnod. 
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II. FORMULATION OF IH 


PROBLEM 


In this chapter we will formulate the problem as a 


nonlirear progran. 


A. 


B. 


DEFINITION OF SYMBOLS 
T : Number of time periods. 
N : Number of cells. 
q(i), : Prob (detecting the target | target and searcher 
are in cell i}. 
Z = (2(1,ј)) is an NXN Markov transition matrix where the 
(1,9) th element 1S the probability that the target in cell 
1 at time period t will move to cell j at tine period tti. 


(QU л (Х(1,8К),. ,.---..,Х(4,5))| represents tte  searcaer 
rorability 415 ritution at time t. That 15, x{1,t) 

enctes the ند وا‎ Y of the searcher being in cell i at 
time period t. At tne start of the search, the searcher 
ceil is assumed to sue known with certainity, i.e., х(1) 
consists of 1 one and all others zero. 


P(t). = C (p(li.t),-.------.P(N,t)]) represents the target prob- 
E y ОТЕ 1 Phat 15 р (1,8) 15 the 
protability target is in cell 1 at the begining. of time 
period t without being detected by the revious 4-1 
Searches. The inltial target distribution P{l) is assumed 
to te known Ly the searcher. 


R(i,j,t) is the probability that the target is in cell i 
without being detected by the previous t-1 searches and 
the searcher is in cell j. 


S(t) = ale ty) is an NxN Markov transition matrix for 

the searcher. іе (1,3) th element 1s zero if subset C(i) 

does not include j (path constraints). 

5 1 دی شا‎ суне (ЕС 10) 15 called a search plan which 
u 


inc es all possible searcher motions for T-time period, 
given that tne searcher starting cell is known. 


NIP FORMULATION OF THE PROBLEM 


Ncw we neea to compute x(t)'s and Е(1,1,%) “5. Since 


x(1) is kuown, we can determine x(t) by the Markovian motion 


as shcwn below: 


x(t) » x(t-1) S(t-1), t-2,...,T. 
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The R(i,j,t) consists of two Markov processes. Note that 
Е(1,1,1) is assumed to be known. So, the R(i,j,t) can be 


computed as follows: 


Rlisjst) = (14 (1)44(1,3)1 ) В(К,1,К-1)2(К,1) 5(153,6-1) 
к, 


٣ and A - 1‏ 71ے ے3 


where d(i,j) is one if i equals 7, zero otherwise. 
Therefore, given P(1), 4(1), S, and 2, the T-time prob- 


ability of nondetection is 


PND =) B(i,jeT), 1,.3-1,2,.-., 1. 
і,Ї 


We want to fina the search plan S which minimizes the 
T-time period PND, subject to the path constraints. The 
final NLP form of the problem is given in Table 1. The 
foliowing properties of tne NLP were proven by Eagle and Yee 
(Ref. 6]. 

Proposition 1: The minimum of the NLP is achieved by a 
deterministic search plan. A deterministic search plan 
consists of ones and Zeros. 

Proposition 2: S$ is a deterministic search plan ir and 
only if S is an extreme point of the linear constraints. 

Fropositiorn 3: The objective function is linear іс S 


wnen constrained to any edge of the simpiex. 
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لے س سے کد سے 


e a وہ نے رووا‎ лыш A dpi. p.m pm ec ^ commi e, ri ee ee 


TABLE 1 
NLP FORMULATION OF THE PROBLEM 


min PND 

subject to: 
S(t) 1 = 1 ПАИС и 
S(t) > 0 23 +1 991۲ 
Suv Jot) s 0 "mh = TM 


11.95. М 


j @ c(i) 
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The optimal solution techniques for hard combinatorial 
optimization problems require more computer time when the 
size of the problem increases. Therefore, they become 
difficult to implement for large size problems. One of the 
most succesful methods of attacking them is the Local Search 
or Neighborhood Search. However unsatisfying  mathenati- 
cally, this approach is certainly valid in practical situ- 
ations. The main shortcoming cf the method is that there is 
no criterion to teli whether the obtained solution is a 
global cptiuun. The local search method is nost appiicable 
for optimization in two main types of problems: 

1. When the analytic relationship of the independent 
variables and the objective function is not known, 
but tne value of the objective function can be evalu- 
ated at individual points by experiments. 

2. When the analytic zorn of the objective function is 
known but there is no finite algorithm for ortaining 
the extrene value(s) in a closed forn. 

The efficiency of the method, relative to another, is 
defined in terms of a Suitable cost function such as nuuber 
of points or experiments required for localizing tne optiuums 
within a specified range. One of the best known iliustra- 
tions of this technigue is the traveling salesman ргорјег 
(TS?) where the objective is to find tae shortest gatn 
passing through each of a number of points exactly once and 
then returning to the starting point. For other exauples 
refer to [Ref. 7]. 

Since the prcblem presented in the previous chapter is 
NP-complete and the current optimal solution techniques are 


impractical for large size proklems, we can try to appiy the 
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local search method asa heuristic approach for gooä 


approximate solutions. 


А. THE ALGORITHM 


First, we will define some concepts in order to intro- 
duce general local search algorithms and then apply this 
methcd to the constrained path moving target search problem. 

Definition 1: An instance of an optimization problem is a 
pair (F,c) where F DK set, the domain of feasible 
points, and c 1s the objective function, a mapping 
4 
CINE--» R 


Definition 2: Given an optimization problem with instances 
(F,C), a neighborhocd is a mapping 


N: FD 2" 
defined for each instance. 


The gereral local search algorithm is described as 
follows: Given an instance (Е,с) ог ап optimization provien 
(miniuizinc) and an initial feasible point s, we search the 
neightorhooá N(s) for an n£ N(s) with c(m) «€ c(s)- So, we 
start with an initial feasible point s and attempt to 
improve the objective function by searching the neighborhood 
of S. If an improvement is found, another search is made іп 
the neighborhood of the imprcved point. This continues 
until nc improvement can be паде. 

Since we know that the solucion of the NLP is an deter- 
ministic search plan (Proposition 1) and it is assumed tnat 
the  searcher starting cell is known, we can reduce our 
feasible region to search paths s={s(1),---,5 (T)}, where 
S(t) is tne searcner cell at time period t. Therefore, we 
can start with an initial feasible search path S, an objec- 
tive function value FND (s), and attempt to find a Search 
path m in a neighborhcod of s such that PND(m) < 2eND(s). ме 
define the k-change neighborhood of search patn s as all 


feasirle search paths m which are identical to s except іп к 
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consecutive tine periods. So, the algorithm for the problen 


becomes: 


Step 1. Start with an initial feasible search path 5. 

Step 2. Find the all possible k-change neighbcrhood paths 

by removing К consecutive cells from s (keeping the others 

unchanged) then расо them with k new cells satisfying 
he path constraints. 


Step 3. Find the k-change neighborhood path m with the 
minimum PND{n). 


Step 4. ІЁ PND (nm) < PND(s), set s=m and go to step 2. 
Otherwise, STOP; current s 1s k-optimal. 

The most difficult task in any application is to decide 
of the proper value of k for the k-change policy. Selecting 
the rigat k leads to very efrective heuristics for the TSP 
{Ref. 7]. We will test the present algorithm for k=1,2 and 
oe 


B. INITIAL FEASIBLE SEARCH PATH 


The algorithm requires two stages. First, dctermine the 
initial feasibie starting search path and then apoly tae 
procedure to it. The initial feasible point may be chosen 
randomly or it may be carefully constructed. in practice we 
need a quick and a good approximate solution. Не do not 
want to be rar away trom the optimal when we start. In this 
study we will use the modified myopic policy (NMP) to deter- 
mine an initial feasible starting path. The myopic 0+750 
which gives optimal solution for a stationary target proo- 
lems, always searches in the next time period t, the celi i 
which has the Largest probability of detecting the target, 
{g(i) Fli,t)}. The MMF is defined as follows. 

For the next time period t, searcher moves Irou his 
current cell i to that accessible cell j which has tne 
largest y(j)p(j,t) value. If all accessible celis j have 
identical values of q(j)p(j,t), then the Searcher will nove 


to the accessible cell which has the minimum Euclidian 
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distance to the cell k having the largest g(k)p(k,t) value. 
If the Euclidian distances are equal, these ties are broken 
randomly. There is probably a smarter technique for 
breaking ties. 

The MMP 1S a heuristic construction meant to produce a 
good starting path, because the neighborhood k-change proce- 
dure may not ve very powerful. We will also test the 
(k- 1) -optimal solution as a starting path for the k-change 
policy. 
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IV. COMPUTATIONAL EXPERIENCE 

Our computational experience is based on two-dimensional 
search problens. А11 experiments presented in this chapter 
were performed on an IBM 3033 mainframe Coüufuter using 
Foctr ar е The Local Search Algorithm was used to solve 
three 10-tine period search problens, where N=9, 25 and 49. 
For each problem, values of k=1, 2 and 3 were used. The 
constraints on the searcher and the taryet patis are defined 
as; the searcher (target) 1S able to move to the cell previ- 
ously searched (occupied) plus all adjacent cells. Cells 
аге adjacent if they Share a common Side. For example, in 


Figure 4.1 the adjacent cells of cell 1, 4 and 5 are: 


С(1)-(1,2,4) , С(4)-(1,1,5,7р , C(5)={2,4,5,6, 8} 


The target transition matrix is; tne taryet CeLainsS in the 
previcusly occupied cell with probability 0.4, and moves to 
the adjacent cells with probability 0.6/m where a is the 
nunLer of adjacent cells. The probability or detection is 


1.0 fcr each cell, isea: 91) ۹ 067 


А. 3 X 3 PROBLEM 





Figure 4.1 9 Cell Search Grid. 
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In this problem tbe target moves among the 9 cells shown 
in Figure 4.1. The searcher starts in cell 1 and the target 
in cell 9, 1.е., initial target distribution is that the 
target is in cell 9 with prokability 1.0 and in the other 
cells with probabiliy 0. The 10-time period search resuits 
are shown in Table 2. An optimal solution was obtained Гог 
211711, 2, 3. However CPU time increases exponentially as 
k increases. As can be seen, the MM2 solution is very close 
to the optinmal. The Fortran code for this problem is given 
in Appendix A. 


A A E AO |‏ سے کک سے عدا ی == | 


TABLE 2 
3x3 PROBLEM KESULTS 


Search Path PND Es scc) 
Myopic 453853658563 0. 28 
k = 1 589658 565 0.2214 0254 
К = 2 25280926. 575254065 9.2214 3. 10 
k = 3 2-5-8 19216 57875565 5 0.2214 26318 
OFTIMAL PND = 0.2214 


йе. Ss es OE Oe. > A ee ола» 


В. 5 X 5 PROBLEM 


In this example the target and the searcher moves among 
m5 cells #Figure 4.2). The searcher starts in cell 1 ana 
the target starts in cell 13 with certainty. The 10-tine 
period search results are shown in Table 3. 

we found an optimal solution only for k=3, but solutions 


for k=1, 2 are cıose to the optimal. The  k-2 solution 





Figure 4.2 25 Cell Search Grid. 





TABLE 3 
5x5 PROBLEM RESULTS 


СРО 


Search Path PND Tine (sec) 
Myopic 6 7 12 13 14 13 18 13 14 13 0375099 
k = 1 6 7 12 13 14 19 18 13 8 9 0.4907 1209 
k = 2 21 12 13 813168 19 14 9 0.4887 10203 


67 8 13922 7E 7225 5302 23 0.48 86 7 ء٦‎ 
OPTIMAL PND = 0.4886 


Ses, у |‏ ےو سے 


DES A A A os lis A is AS in MO Ei 
~ 
1 
о 


diifers from tne optimal solution опіу іп the rourth digit. 
Similar to the 3x3 probleuw the MMP solution is close to the 


optimal and C2U time increases exponentially. 


С. 7 Х 7 PROBLEM 


In this proplen the target and the Searcher moves among 
49 search celis shown in Figure 4.3. The searcher starts in 


cell 1 and the target starts in cell 17. The 10-time period 
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search results are shown in Table 4. 4e obtained the 
optimal solution for only k=3. The percentage difterence 
between the MMe solution and the optimal solution is only 
2 ur. For k=1 and 2 same result were obtained. 
Exponential increase in CPU time is more steep than the 
previous problems. 

In addition, the total enumeration method was used to 
find all optimal paths for each problem. The results are 


Shown in Table 4. 
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Figure 4.3 49 Cell Search Grid. 


In tact, for the 5x5 and 7x7 problems we increaseu the 
search area of the 3x3 problem with tne Sange target and 
Searcher Startiny cells and the taryet transition matrix. 
For each problem a similar fpattern waS obServed tor optiaal 
paths. Specifically, the searcher goes to the targct's 
starting cell as soon as  possibie, tunen starts to search 
outside of tuis cell similar to the expanding syuare search. 
Graphical representation of exponentiai increase іп CPJ time 


as k increases, is shcwn iu Figure 5. 1. 
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D. MCDIFIED MYOPIC SOLUTION RESULTS 


The reason for using the MMP was to find a near optimal 


starting solution. Ihis objective was net in the probiens 
Shown so far. In these problems, the mean position of the 
target does not move, given no search. In order to examine 


the possible effects ofa moving mean target position, two 
5x5 search problems were solved with different transition 
matrices, initial target distributions, and detection 


probatilities. 


1. Fast Target Problem 


In this problem the target starts in cell 13 ага the 
Searcher starts in cell 1. The target transition is such 
that the target stays in the previously occupieä cell with 
probakility 0 and moves to the aüjacent cells with prob- 
ability 1/m where m is the number of adjacent celis. The 
detecticn probability is 1.0 for each cell. Тһе 10-+іпе 


period search results are shown in Table 5. 


TABLE 5 
5x5 FAST TARGET PROBLEM RESULTS 


Search Path PND та пе (бен 
Myopic 2 78 8 13.118. 1+ : 17 0.4770 
k = 1 221 12 17 18 19 14 9 8 0.3742 59 
k = 2 2 7 7 12 17 18 19 14 9 9 0.3742 10.19 
k = 3 27 7 8 13 12 17 18 19 14 0.3775 67.93 


OPTIMAL END - 0.3742 
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In this case the MMP did not perform as well as it 
did in the previous 5x5 problens. An optimal solution was 
obtained for k-1, 2. Additionally, x=3 policy did not reach 


the optimal solution while requiring more CPU time. 
2. Escaping Target Problen 


For this problem, the target starts in cell 21. It 
then stays in the current cell with probability 0.1 and 
moves ore cell up or to the right with protability 0.45. If 
it reaches one of the top boundary celis (1,2, 3, +) ог 
one of the right bcundary celis ( 25, 20, 15, 10), then it 
will move one ceil to the right or one ceii up with prob- 
ability 0.9 апа it remains in the current cell with prob- 
ability 0.1. When it reaches cell 5 it will stay there 
forever and is assumed to have escaped. That is, the prop- 
ability of aetection in this cell is 0, while for the other 
cells the probability of detection is 1.0. Ine 19-tiae 
period search results are shown in Tabie 6. The MMP path 
has significantiy greater PND than the optimal path even 
though it differs in only one time period from an optimal 
path. Optimal soluticns were obtained for k-1, z, 3. 

For the last two problems all optimal paths were 
obtained by total enuteration and are shown in Table 6. In 
the fast target probien, the optimai search path placed 
search effort around the targets starting cell. If target 
noves іп а specific direction (escaping target problem) this 
reduces the number of possible optimal paths. Іп this case, 


optimal paths put a Farrier in front ot the target. 


E. INCEFASING THE NUMBER OF TIME PERIODS 


To examine the effect of increasing the number or time 
pericds on CPU time, 3x3 problem was soived for 15, 20, 25 


and 30 time periods. The graphical results are shown in 


25 


em ume UN ios GN (unam i کے‎ O سے‎ < Ñan O es E ici A ٠ en и (а gen ee, en an, Den quoda, GT ee, Ge ee GE en, mn Een a ee Ge Oe eee سے سے‎ r——————— ——————— HÀ €t 


Муоріс 6 11 12 
k = 1 6 11 11 
6 11 11 
1 6 11 


Problem 


8 
12 


12 


12 


12 


12 


tix 

eu 

Me 

ін 
mad mua mua مہ‎ рд Юю М N Oy ОУ С 
O N N N М J N HB NY “М HD یج‎ 
نہ‎ М 3“ لح لد لد لد لد لد له لد لد‎ 


12 


6 6 11 
API 

СЕТ 6 11 11 
1 6 11 


Cie SG Gann ease О > Go Ge Ge афа» брань во Gees Se eee ae Ge а‏ سس An Am cn, innen Cot GE OE Geos A Ge Gi GS As CE. GR Phebe Ge Gees я о, фр Ga Шым». Gn Gee Ges Ee Ge GS ef Ei. Ce Gn‏ کا میں سے 


12 
12 
12 
12 


TOTAL 


9 
17 


12 


ТАВЉЕ 6 
ESCAPING TARGET PROBLEM RESULTS 
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ENUMERATION RESULTS 2. 
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PND 


0.3742 


927153 0 


CPU 
Time (sec) 


0.68 
3.03 
16.46 


(sec) 
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1524 


Figure 4.5 for k=1, 2, and 3. For T=30 and k=3 program was 
stopped at 3600 seconds CPU tine. The increse іп СРО біде 
Гог k=1 was considerably less than for k=2, 3. We can say 
that k=1 policy was the most CPU TIME / (1-PND) eifective. 

Fcr the presented proklems we also tested the 
(k-1)-change optimal solution as a starting path for the 
k-change policy where k=2. But starting with this alterna- 
tive path did not improve the soiuticn obtained by using a 
MMP starting path. 
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V. ERANK-WOLFE ALGORITHM 

Another method applicable to the problem is the 
Frank-Wolfe  (F-W) algorithm. The main motivation оғ 
Selecting this algorithm is that this method implicitly 
examines all extreme points of the convex polyhedron, rather 
than just the k-change ones. In 1956 Marguerite Frank and 
Philip Wolfe proposed this method for solving non-iinear 
programs having a convex differentiable objective function 
and linear constraints. Since our objective function is not 
convex this method will determine an approximate solution to 
the proklen. 

Ihe F-W algorithm is a feasible direction method and may 
sinply stated as follows; Given a feasible pcint at any 
iteration, an improving feasible direction is determined by 
linear program (LP). The objective runction of the Le is 
formed ру using a linear approximation (first order Taylor's 
expansior) of the objective function of the NLP and tne 
constraints are the original linear constraints cf the NLP. 
Then the step size is determined by a line search. ihe 
algorithm continues until no direction is found to improve 
the otjective functicr. For further intormaticn refer to 
нес. 81. 


А.  AEPLICATION OF F-H METHOD 


Given S, x(t), P(t), 4(1), and Z, the objective function 


can be written for each time period t as follows: 


PND (5) = ) р (1,6) (1–а (1)х (1, #) )2 (1, Ј) У (Ј, 2 +1) 
P 
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where v(i,t) is the probability that the target is in cell i 
at the beginning of time period t and will not be detected 
by the remaining searches. ke can compute v(i,t)'s in a 


packward recursive manner as fcllows: 


v (i, t)=) {1-g (1) X(1,¢)}2(1, 5) V(j,tt1) 
J ECL) 


191,255.22 «N and 2ج1 > ج‎ 3-7۲٦٤ 


Since P(1) is known, the p(1,t)'s can be computed by the 


forward recursion 


pG,te1) - 9 p.t) (1-a(i) x (à t) ) z (i, 5) 
\ 


2,151,220 00 апа Б: 12; 422714! 


For a given search pian S the p(i,t) and v(i,t) will be the 
same for each tire period. So, we need to compute them once 
for each search plan S. 

Since x (j,t) = x(i,t-1)5(i,j,t-1), then the 6۴ 


vector for time period t can be computed ¿rom the following: 


д РМО (5) 


Y (13,5) = 35(1,3,1) 


=-x (ist) p(jett1) 9 q(j)z(j.k)v(k,t+2)- 
кёС(3) 
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Then the feasible direction of descent is found by solving 
the LE subproblem shown in Table 7. As we explained before 
the ccnstraints of the LP must be the same as the NiP's 
constraints. Note that the LE's constraints in Takle 7 is 
another way of expressing the ccnstraints in Table 2. The 
soluticn of this LP subprobiems is trivially found as 
follows; For each i and t, choose 7 C (i) witn minimum 
Y(i,j,t), call it j then set M(i,j ,t)=1 and M(1,j,t)=0 for 
Т 





ТАВЉЕ 7 
LP SUBPROBLEM 


ліп EU (ME М (1, ј, С) 
A 3 
subject to: 


Em noc EE 


een سے‎ an Sana meme مل‎ Bit ts, E ےھر‎ | 


> 


JECC) 
мою, 1,25) 209 LIC 
дэ й t=1,...,T-1 
This solution is an extreue point of the linear 


constraints.  Thererore, solution of tne LP is deterministic 
search plan M which defines a unigue search patih N. Since 
we are only interested in deterministic search paths, че 
choose the step size as 1 if PND(m) < PND(s) and zero otaer- 
wise, ie., tne process is terminated when PND(m) > PND(s). 
So, the second algorithm becomes: 


Step 1: Select an arbitrary feasible search path 
Soto (1) gee, s (1-1). 


ont 


Step 2. Determine a new search path m by solving the LP 
510 го еш. 

Step 3. If PND(m) < PND({s) set S=n o to step 1. 
ee, STOPS р E 2 


В. CCHPUTATIONAL EXPERIENCE FOR F-W METHOD 


we applied the algorithm tc the 3x3 problem (defined in 
Chapter 4) with 30 randouly selected starting search paths 
(nyopic search path included). The algorithm did not reach 
the optimal solution. For 7 ori the 30 paths (myopic path 
was cne of them the algorithm did not improve the starting 
solution. The closest solution to optimal (0.2214) was 
0.2328 which is the myopic path result. The maximum and 
minimum CPU times were 0.04 and 0.11 seconds, respectively. 
The results are shown graphically in Figure 4.4. The 
Fortran code of the algorithm for the 3x3 problem is given 


in Aprendix B. 
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VI. CONCIUSIONS 


нє have investigated the effectiveness and computational 
efficiency of the Local Search Method and the Frank-Wolfe 
Method for several two-dimensional search problens. 

The heuristic Local Search Method appeared clearly 
satisfactory for the examined search probiens. However, the 
exponential increase in CPU time will limit the use of the 
method for higher k values. Also increasing k does not 
necessarily improve the solution. This procedure appears to 
be useful because it allows a trade off between solution 


accuracy, iee., closeness to the optimal search path and CPU 


time. For further analysis this method can be tested тог 
different probiens, k-change policies and number of tine 
periods. 


Ihe Frank-Wolfe method approach did not perforı well itor 
the  rrobiems examined. An alternative way сі improving 
efficiency of this algorithm nay be to perform a line search 
after determining the feasible direction of descent. But 
this would increase the CPU time. Both methods are also 
applicable to Brown's oridinal problem (Ref. 9] ang they may 
be efficient for this problem because of its convex objec- 


tive function. 
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FORTRAN CODE OF LOCAL SEARCH ALGORITHM 


XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXxXXXXXxXXXXx 
x METIN SAGAL х 
X THIS PROGRAM APPLIES LOCAL SEARCH ж 
X ALGORITHM TO 3X3 PROBLEM FOR K-1. x 
XXXXXXXXXXXXXXxXXXXxXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
ШІКЕСЕК Т.ИН,Р(600,50), ТТС50),5(50),С(25,25) 
INTEGER AA(9,5),IN(9) 
RESIEEUDPC20),PBC500),BBC50), XMIN,PND 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
X INPUT x 
T=TIME PERIODS 
NASYOF SEARCH CELLS 
S=STARTING SEARCH PATH 
іме ADJACENT CELLS 
ASADJACEMT CELLS 
CONSTRAINT MATRIX 
X k X X X ХХХ ЗЕ ЗЕ Эб ЗЕ З Ж ЭК ХК Ж ХЭ Ж КК Ж ХЭ Ж Ж Ж XK ЭК Ж XK XK Ж ЭК Э Ж Эбх Ж 
۲٢۸۱۲۷۷5 100) Т,НН 
ЕОКМАТС512) 
КЕг 00057115) (5(1)»,1:1,1) 
БОК 11111) 
БЕЛл 101; (ІмСІ),131;, ММ) 
ЕОКМАТС911) 
ГпБЕО 22102) AAC1.J),3J=1,5),1=1,0NN) 
ЕОК 220511) 
се сацы дс) (ССССІ, 22), 231, 1И27; 131; ММ) 
ЕОКМАТС912) 
XXxxx TARGET INITIAL PROB. DISTRIBUTION xxxxxx 
DO 15 K=1,NN 
PB(K) =0 
066 0 ٦ 
DO 25 К=1,НН 
BB(K)=PB(K) 
xXXxXxxxx FIND PND FOR STARTING PATH S x**xxxxx 
DO 55 0 
ZCIESCITI) 
РАЈ МИШЕЛ, РВ, Т.НИ. ВВ,РНОО 
XMIN=PND 


13,19 ) )ہ۸ 

XX*xxx*xXXXx CHECK PATH CONSTRAIHTS **X*Xxxxxxxxx 
ЇЕСЕ 11-1),25(119412) Ед0.0) 60 TO 10 

FIND PHD FOR NEW PATH ×× ×× رر پ‎ XK 

BROBCZ,PB,T,HH,BB,PHD) 


X X X X K Fk ¥ X X 


CALL 
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MM? 1 


Mèl 


- 
~ 


MM 


KEEF‏ ررڈ××م+< 


М 


IFCPHD.LT.XMIN) THEN 
XXXXXXXXXXX CHANGE THE NEXT CELL ××××××××××××× 


1192607 7023553 


ES 


نے ہم 
кк‏ 
LE‏ 


| ~ 


—= 


0) THEN DO 


T 


oag 
AD 


ہے بے ہم 
ах‏ 
ста б.‏ 
ft te of‏ 


~ О 

یی ہس 4 
Ov | on‏ 
سر یں یی ہے. 
2-0 
N k-‏ 


50 


STOP XXxXXXXK XX 


H IS Xxxxxx" 
) 


AL PND +71۹ 


END 
*xxxx IF THERE IS NO IMPROVEMENT, 


XXXXXXXXXXxX*XXXX CALCULATES PNHD XXxXxxXxXxxxxxxx*xx 


AEBS) 


~ + ~ 
neo 
v Qv 
25 СО 
تح ح کو9‎ 
жа ж 
N^) & Уу 
“СМ . 
+ + 


~ + ~ 


SARE CS) 
JT SEDC) 


+ 


m m ۱ئ کر‎ И ~ од ~ 

МЗ О ме Ле ОД ~ СК 

ме чм? MO o CO М2 

са са со д eaa eaa. 

Q- 0. C. * Q. * C. * о. 

^ A C UY X NT ox NT ж 
NMN = -N г 

9 9 оо 8 6 + ++. 

ЕЕ en‏ کے 

oN Nm LL гг ^^ 

٥ل‎ ٧ل‎ МЕ МГ ме [~ ~ ОД 

м мч чы > СО ме СО ~ 

са са са лзеза. сова. са 

ВАС lel (Bê НЕ ВО а <> 
ж ж ж ж KU) KM) ж ZT Mx 
CUT rr Neer ON -~m 
Ө жо Ж ә э “Т % + . -4 м 
++ ++ +++ ص نپ‎ «Її 
4A CAT FM AA | ^ mm ч || لنا‎ 
بح بے لح ہے ہے‎ Ж М ОТ 
М2 М М2 М2 М2 М2 М2 ЦО) М2 گے ہج‎ 
со со са са аб 60 со 6 Са СЈ === 
о.а.а.а.0.0.0. ж0, Г~ ~ 
ж ж ож ж ж ж ж ЦУ ж гэ zZ 


<O MOM NMNm N OA O 


а s e > % è è a з DOS 


A 793g) А ١١۱ 
ہس یسل ہس مسر سر ہر ہر ےہ‎ м 
2410] LEANMTUN OF oO O^ 
Q DI MS SU w w w w w w мМ МУ 


Qc ES E ESE 
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l, NN 
ND+PBCK) 
] .HN 

= ٦) 


)-Р 
К- 
K) 


( 
JE 


URN 


хх к Хх к A ARA Ж 


СО Ср ОО ан 


С С O O س‎ O ہے ہے بے‎ 


хххххххххкхххжжык IHPUT DATA 


оо очо о ین ہے ہے‎ 
из OO СО m О О ےم‎ 
© 
Пеја С ан ОО ہے‎ 4 О СО 
ох 
шо "DO OOO 
DT 
ا ما‎ со Or ت ن ن ہے نین نی‎ 


Cor WROD с 
МАМА МО ИЛ И ~ 0 00 о0 СК он пп С) بت بی ہے‎ СОЗ О 
МАСУ СМ МУ МЕ یہ‎ г~ 00 

OO OD کہ( یح ہے رح ہے ہے ہہ ہے ہے‎ ИО +, О о О О > О 
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ОООООООООО 


100 
117 
102 
105 
104 


СӘ” СЭ СУ OOO 


OOO OOO 


O G G) 


999 


FORTRAN CODE OF F-W ALGORITHM 


INTEGER TIME, T,NSTINCIIFALCI, II ء‎ СЕН ОШ 
REAL (9,و9)ج‎ , ۲)9, 0(۷) ۲ ۵٦ 
КЕЛІ С(9,10),ХМІМ,Р(9,10) 
XOOOOOOOOOOXX XX XX XXX XX XEXX X XX X X X X XXX XX XXXXXXX 
* INPUT х 
TIENE ص5‎ 
2ا‎ 80۴۲ CELLS 
S=STARTING PATH 
IH-80F ADJACENT CELLS 
A=ADJACENT CELLS 
R=TRANSITION MATRIX 
ж ас ЭК Эк Э эе Эб ЭК ЭК К ЭС ЭК ЭК ах ЭК Ж XK Эбх ЭК Э ЭК ЭК ЭК Эб ЭК Э E ER Эх 


1 7770 
FORMAT(212) 

READ( 5,1019) D 
ЕОКМАТС1011) 

READ( 5,102) (1Н4({1),1=1,9) 
ЕОКМАТС911) 

READ(5. 105) ОСАСТ ОСО ТООТ TD 
ҒОКМАТ(911) 

КЕАр(5,104) ССОКС1,93,У751:/13,151,Н)Э 


ЕОКМАТС9Е3.2) 

XXXXxxXxxxxx DETERMINE V(CI,JO'S XXXXXxXXXxxxxXxx 
САРІ УРІНООС5 , КОМОЮ 

«кк кк кх DETERMINE P(I,J)'S XXXXXXx*xx*xxxxx 


CALU PFINDCSS ToPo 


XX*X*xxXXxXXX DETERMIHE X(I,J)'S ххххххххххж«жх 
CALL ХЕЛЕН А) 
AEREA FIND PHD FOR A STARTING PAT Hes xx 4x2 ee 


САРЕЛРКО ВАРА А ۶۶ ۵۹ 
XXMIN=PND 


хжзнювеє» РІНО КЕН ЕХТЕЕМЕ КОТИЛ осии 


2(1)=1 

САГ СРТН СЕ ЕСОН УК БЕС ЕО 
2020-06) 

CALL ۲۷۱۷۷ ٹب ) ے , ھ۷)‎ (4 77 88886 E 
LIF CELE 

CALL CELNBCS,£C65), IN XR OT TED 
CCG CEL 

САЇГ СЕТН СӨ,208у/1ЇН Хо 22020000 


ANNAN OOO ООО ООО 


ООО 


90 


11 


500 


600 


15 
25 


ДОО СЕСЕ 

МОМА РОСА ТУ РАКА МАР СЕСЕ) 
2(6)- СЕ. 

аны Гаа выса сб С IN XR: VASP CELL) 
2070-СЕ11 

2аэ 2012110(7,2(7):11Х,К.У,А,Р,СЕ11) 
208.) =GEUL 

CALL CFIND(8,Z(8),IN,X,R,V,A,P,CELL) 
Z(9)=CELL 

EZ CETINDSIFZEII.IN.XSR.V,A,P,CELL) 
ЕСО СЕСЕ 

SIEFZERTHDEND, ZCI03 ,IN,X,R.V,A,P,CELL) 
24011) - СЕСЕ 


XXXXXX FIND PND FOR A NEW EXTREME POINT xxxxxx 


CALL PROB(Z,PB,T,N,BB,PND) 


XXxXxxx COMPARE TWO EXTREME POINT'S PND Xx xx xx 


IFCPND.LT.XXMIN) THEN DO 
ХХМІНЕРНРО 
20-90 1-1.Т 

5(1)=2(1+1) 


ШЕНІНЕ МЕН УСТ,Ј)"5, РСЕ,Ј)"5, XCI,JO'S ж 


CALL VFIND(S,T,N,V) 

CALL PFIND(S,T,P) 
DO 11 I=1,8 

РЕС І2-РСІ,1) 
ШЕСІ)-РСІ,1) 

CALL XFIND(S,T,N,X) 

60 ТО 999 

END IF 


жх TF THE NEW EXTREME POINT DOES NOT IMPROVE xx 
XXXXXXXX THE OBJECTIVE FUNCTION, STOP xxxxxxxxx 


FRINT,'MIN PND IS',XXMIN | 

PRINT, 'x*xxxx OPTIMAL PATH IS xxx«xx' 

WRITEC6. 600) (S(I),I=1,T) 
FORMAT(3X,1012) 

STOP 

END 


xxxxxxxxxxxx CALCULATES V(I, J)'’'S xxxxxxxxxxxxx 


SUBROUTINE VFINDCS,T.N,V 
REAL V(9,11) 
آ۲ ۹01۹ ٰ گ۴۲۶‎ 
DO 15 I=1,8N 
۷)۰ 0 0۵ 


J-T 
K=J+1 
212212 01:101,Ку9 .3хУуС(2,КЭУ .3хУ(8,8) 
vice ХУ СТ К. аў Са, Ку геи, Кж оис, Кә 
VCS) Jee SxUC2,K)t.GQXUC(S,K0)t.5*»U(COo, K) 
CS dJONMEEE 2xVC)IK)t.GasVCG, RO) t. 2*V(CD,KOt 2*VCY , KO 
И о се КО. о Са ۹۱۲۴) KI 
205, DEED Cb. JOXC-15*sVC6; Kt s охуса, кэ) 
co, JL ака ус Каа Со, Ку саў СЯ, Ко 
MC, JUNE SxVCG KIF GAV / ,5۴(+ ٭ڈ,‎ ۷)5 [( 
ОСЕ ООС КУТ )کے‎ KIP GVE, KIH 2*V(9. K) 
СО, 1 2 И СВ КОН оку СОКО акУС9,К) 
WES (CIAO 
1ل لت‎ 
IFC J 2 00 10-25 
RETURN 


9 


END 


AXRAXX CALCULATES COST COEFFICIENTS ANDER aA 
X*x*xXxXXXXXxx SOLVES LP SUBPROBLEM xXx*XxxxxxxXx 


OOOO 


55 


56 


40 


SUBROUTINE ۴ء.)‎ ۱۲۲۱۱۲۲۱ 6" پ٦‎ 
REAL R(9,99),V(09,119, PC 92109 11115۲ 
ТНТЕОЁК ТТЇМЕ,11МЕ,ММ, 1 10927, АС9/09 CELL GE 
CMIN=1 
IK-IHCMM) 
TTIME-TIME*1 
DO 40 I=1,IK 
J=ACMM,1) 
PP=0.0 
IB=IN(J) 
ТЄЕСР СУ, ТТНЕЭТЕО“ ТНЕМ рбО 
DOU 55 : ۵8 
PP-PP*RCJ,ACJ,IID)OXVCACJ, IID,TTIMED 
CONTINUE 
C(MM,J)=-(0.0001)XPP 
ELSE DO 
]) 6 60 
PP=-PPFREILATIZITII VL AUDIT III И КЕЎ 
CONTINUE 
CCHMM,;JOos-CRCOSCIBSIED XP 
END IF 
1:6) 02220 ММ 0 
CMIN=CCMM, J) 
GELD 
END 
CONTINUE 
RETURN 
END 


10) 
zul 


XXXXXXXXXXXXx CALCULATES X(I,J)'S Xxxxxxxxxxxx 


SUBROUTINE XFIND(S,T,N,X) 
INTEGER S(10),T 
REAL X(9,10) 
DO 60 1-11 
Х(3,193:0.0 
CONTINUE 
CONTINUE 
DO 78 121,T 
кас к с чаў 
RETURN 
END 


XXXXXXXXXXX*XX CALCULATES PND XxXxXxXxxXxxxxxxxx 


SUBROUTINE PROBCS,PB, TN BBSPHDO 
۲٢۸۲۰۸۸) 50( ,۲ ۳ )9 (,۲ً971٦( 
ЕНТЕСЕК ІШ», Г, ӘСІП) 


S E 

DO 71 K=1,KP 
PB(S(K3)3=0 
ДА(1)= „ахРВС1)+ 2 хРВбЕаЈЊ FRENCH) 
AAC2Z)=.3*PBCL)+ . 4ھ‎ DIS 
ААС5)=.2*5РВС2у+, 01ھ‎ 
Ад(сај=. оХРВС1)+ахРВвСа Ко АВРО О DB) 
AACS) =.2*PBC2)+  2RPBUG04 2G 2 Bis te РАВНЕ а 8.) 
AAC6)=.3*PBC3)+.15*P BCS ta bon te of О 
AAC7 )2.2x*PBC4)t . GXPBC7)* .OXPBC&) 
AACG)TS.I5*PBC5)*  S*PB(C7OdS AREAS ABC 
ААС9Э) 5, 2ХР С6 УМ ,2ХР СЭЖ АЕН 


00 72 ІКсі,Н 
PBCIK)=AAC1K) 
CONTINUE 


40 


71 CONTINUE 
РВС5(Т)):0 
PHD-0.0 
DO 50 K-I,H 
FUBZERDEPBEN) 
50 CONTINUE 
DO 42 K=1,H 
PB(K)=BB(K) 
42 CONTINUE 


RETURN 
END 
E 
E XXXXXXXXXXXX CALCULATES P(I,J)'S XXXXXXxXxxxxxxx 
С 
SUBROUTINE PFIND(S,T,P) 
REAL P(9,10),PM(9,10) 
BITEGER SC10),T,M 
509, 1)=1.0 
Р (9,12 =1.0 
DO 85 I-1,8 
РАСТА] ) = 0 
85 РСТ,1)3:0 
0٦50 2,۴۲دل‎ 
M=J-1 
BMICSCM)IM)70.90 
mus. QEOPMC)I,MO)Y.2xPMC2SMDO*.2*xPMC4.,MD 
mos S3SPMCI,MO*t.GXxPMC2O;MDO*.SxPMCS;MO*.15xPMC5,M) 
пае 2 ے2‎ 0٣ )2 NONO XPMCS, M)*.29X*XPMC6,.M) 
125 .31ХРМСГТ,МУТ Ч ХРМ Ч ,М95.15ХРМС5,М)?.3ХРМС7,М) 
0105 25РМСГ2,Му)4 .2ХРМС4, 27. .4ХРМС5,М»94.2ХРМС6,М) 
о о=РС5,.Ј)х. СХРМСВ ,М) 
Luz sSxpMCS.,MO)tT.15*PMC5,MO)*.GXPMC6,MO*t. 3xPMC9, MD 
ша с 2*PMCÓ,M)t.6Gx*xPMCIL.M)t.2xPMC&8,MD 
Mec T= Se PMCS, M+ oe PRC? МО + 9% PMC 3,2 DE 73x E09, M) 
PC(9,J)=.2%PM(6,M)+.2xPM(8,M)+.4xPM(9,M) 
00 86 1=1,9 
86 РОШОЊЈО=ГРСТ,Ј) 
Е 


80 CONTINU 
RETURN 
END 


XXXXXXXXXXXXXxxXxx [HPUT DATA XAXXXXXXXXXxAXXXxxXx 


ООО 


10 9 

4565856585 

365656563 

126000000 

25500000 

256000000 

145700000 

245680000 

356900000 

4/8000000 

572900000 

689000000 
040030000030000000000000000 
020040020000020000000000000 
000030040000000030000000000 
020000000040020000020000000 
000015000015040015000015000 
000000020000020040000000020 
000000000050000000060050000 
000000000000020000020040020 
0000000000000000 500000 50040 
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